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(54) Data streaming in a computer system 

(57) A data handling arrangement for a computer 
system, with particular application to multimedia sys- 
tems, allows device adapters (control units) attached to 
the system to autonomously (without interrupting the 
system processor) control processing of a data stream 
of arbitrary length through memory buffers which are 
smaller than the stream. In this (stream processing) op- 
eration, data constituting the data stream flows through 
devices controlled by the adapter in succession, and is 
held in shared memory buffers as it passes between de- 
vices. The adapters are prepared for the stream process- 
ing operation by a system processor indicate their prep- 
aration status to the processor, receive an initiating sig- 
nal from the processor, and then proceed to direct the 
operation to completion without further assistance from 
the processor. In the operation, the adapters coordinate 
usage of the memory buffers by respective devices. Co- 
ordination is accomplished using a notification signalling 
protocol defined during preparation of the adapters. For 
notifying each other of buffer events (filling, emptying, 
etc.), the adapters use a peer communication feature of 



a system channel which connects the adapters and de- 
vices to the system processor and memory. This feature 
permits one adapter to directly communicate "notifica- 
tion" information to another control unit without involving 
the system processor. Information furnished to the 
adapters during their preparation includes descriptors 
defining the memory buffers and the notification protocol. 
It also may include descriptors enabling a control unit to 
synchronize the processing of data in a stream with 
events external to the stream; e.g. an external timer func- 
tion or events associated with the processing of another 
data stream. Thus, for instance, video and audio com- 
ponents of a live motion picture presentation could be 
synchronized. The controlling functions affecting stream 
processing are isolated from the controlled devices, and 
the processing functions performed by each device on 
data in a stream are performed independent of the func- 
tions performed by any other device relative to the same 
stream; thereby simplifying development of new devices 
and new processing functions. 
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Description 



This invention relates to the handling of data trans- 
fers between components of a computer system and 
has particular though not exclusive application for im- 
provement of contemporary multimedia functions. 

In contemporary computer systems, transfers of 
data between processor or memory subsystems and pe- 
ripheral devices, generally have, been tightly controlled 
by the processor subsystem. Typically, each peripheral 
device receives a command block from the processor 
subsystem initiating a single data transfer operation be- 
tween the device and a predefined part of the memory 
subsystem, performs the operation, interrupts the proc- 
essor subsystem to report the concluding status of the 
operation, and then waits for another command from the 
processor subsystem. 

A problem in this respect is that operations requiring 
movement of large volumes of data (hereafter "data 
slreams" encompassing multiple block lengths) between 
buffer spaces in the memory subsystem and multiple pe- 
ripheral devices, interruption handling operations of the 
processor tend to degrade efficiency (reduce the rate of 
data throughput). This effect is especially pronounced in 
multimedia systems wherein for example audio and vid- 
oo components of a "long" motion picture (e.g. one taking 
over an hour to present) are stored electronically on a 
mass medium (e.g. CD-ROM) in a compressed and pos- 
sibly encrypted form, and processed by peripheral de- 
vices (lor decompression and/or decryption) before be- 
ing aophed to speaker and display monitor components 
of the system 

In order to use buffer space in the memory subsys- 
tem efficiently, the processor would segment the process 
relative lo each device into many commands individually 
defining the handling of small blocks of data (blocks 
whose lengths are orders of magnitude shorter than the 
length of the aggregate data stream that is to be proc- 
essed) and monitor status of each block operation (via 
interrupt handling) before advancing the process. As- 
suming that the memory buffer spaces allocated for in- 
dividual block transfers are of reasonable size, the laten- 
cy/delay introduced by such status monitoring actions is 
difficult to accommodate. 

The difficulty is compounded when the block han- 
dling processes have synchronism restrictions; e.g. re- 
strictions requiring sound and picture data of blocks to 
be applied synchronously at respective speaker and dis- 
play destinations. It is further compounded by the 
number of devices sequentially handling the data. Thus, 
for example, data that is processed successively by four 
devices (e.g. loaded into memory buffers by a first de- 
vice, decompressed by a second device, decrypted by 
a third device, and routed to a destination by a fourth 
device) would encounter much more delays in processor 
interrupt handling than data that is handled successively 
by only one or two devices. 

The present invention seeks to provide a more effi- 



cient mechanism for handling such data stream func- 
tions; i.e. a mechanism which has less latencies associ- 
ated with processor interrupt handling than contempo- 
rary systems and therefore can use smaller memory 
5 buffers between units. 

This objective is achieved by providing a bus system 
between the processor and the peripheral devices which 
allows for devices to act as bus masters, and directly 
communicate with other devices, without channeling 
io their communications through a central processor and 
adapting devices that attach to such bus system to au- 
tonomously perform data stream handling operations 
without interrupting the central processor system which 
initiates respective operations. 
« Accordingly there is provided, in a first aspect of the 
invention, an apparatus for handling data transfers in a 
computer system that contains a processor subsystem 
a memory subsystem, peripheral devices, device control 
units controlling said peripheral devices in response to 
*> commands received from said processor subsystem 
and a channel linking said device control units to said 
processor and memory subsystems, said channel hav- 
ing a peer communication feature enabling said control 
units to communicate directly with each other without in- 
2S tervention of said processor subsystem and without in- 
termediate buffer storage in said memory subsystem of 
information being communicated between said control 
units, said apparatus being arranged to enable one of 
said control units to direct processing of a data stream 
30 of arbitrary length, by a device controlled by said one 
control unit, in cooperation with first and second other 
said control units respectively controlling first and sec- 
ond other devices, said apparatus comprising: 

means in said one control unit for receiving setup 
35 command information defining: (1 ) input and output buff- 
er storage spaces in said memory subsystem that are to 
be managed by said one control unit in cooperation re- 
spectively with said first and second other control units 
(2) a notification protocol, defining signals to be directly 
40 transferred between said one control unit and said first 
and second other control units via said peer communi- 
cation feature of said channel, said signals to be used 
by said control units for managing use of said input and 
output buffer storage spaces; and (3) a process to be 
45 conducted, on a said data stream of arbitrary length in 
said input buffer storage space, by said device controlled 
by said one control unit, said data to be written to said 
input buffer storage space by said first other device, said 
process to produce result data to be written to said output 
so buffer storage space for further handling by said second 
other device, and said process to be conducted to com- 
pletion without interruption of said processor subsystem- 
said input and output buffer storage spaces being char- 
acterized in that each has insufficient storage capacity 
to simultaneously store all of the data potentially con- 
tained in said data stream; 

means in said one control unit responsive to said 
setup command information for preparing said one con- 
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trol unit and said device controlled by said one control 
unit to: (1) perform said process defined by said com- 
mand information on a said data stream to be conveyed 
through said input buffer storage space; (2) forward data 
resulting from performance of said process to said sec- 
ond other device via said output buffer storage space; 
and (3) manage usage of said input and output buffer 
storage space, in cooperation respectively with said first 
and second other control units, via said notification pro- 
tocol and said peer communication feature of said chan- 
nel; and 

means in said one control unit, responsive to an 
initiating signal from said processor subsystem and to 
conditions established by said preparing means, for di- 
recting a streaming operation in which: (1) said process 
is performed on data of said data stream forwarded 
through said input buffer storage space; (2) data result- 
ing from performance of said process is forwarded to 
said second other device via said output buffer storage 
space; (3) transport of said data stream through said in- 
put buffer storage space, and transport of said resulting 
data through said output buffer storage space, are jointly 
managed by said one control unit and said first and sec- 
ond other control units using said notification protocol 
and said peer communication feature of said channel; 
and (4) all of the foregoing functions are carried out to 
completion : i.e., until all of the data in the data stream 
has been processed and forwarded, without interruption 
of said processor subsystem. 

Viewed from a second aspect the invention provides 
a device adapter for controlling a device performing op- 
erations requiring processing of arbitrarily long data 
streams in a computer system, said adapter comprising: 

means enabling said adapter to communicate di- 
rectly with other device adapters through a channel of 
said computer system having a peer communication fea- 
ture permitting such direct communication; 

means for receiving setup command information 
from said computer system 

defining: (1) an output buffer store having dimen- 
sions chosen by said computer system; (2) a source of 
data to be supplied sequentially to said device controlled 
by said adapter, said data constituting a data stream of 
arbitrary length; (3) a process to be conducted by said 
device controlled by said adapter, on all of the data in 
said data stream, with data resulting from said process 
to be written into said output buffer for further process 
handling by another device controlled by another adapt- 
er; and (4) a protocol for communications to be conduct- 
ed between said adapter and said another adapter, dur- 
ing the performance of said process on said data stream, 
to coordinate the use of said output buffer by said device 
and said another device; wherein the length of said data 
stream exceeds the capacity of said output buffer, requir- 
ing repeated use of said output buffer to convey portions 
of said resulting data to said another device through said 
output buffer, and wherein said protocol requires use of 
said direct communication feature of said channel to in- 



dicate when data in said output buffer is available for fur- 
ther process handling by said another device; and 

means responsive to an initiating signal issued by 
said computer system after said setup command infor- 

5 mation has been received by said receiving means, and 
to said setup command information, fordirecting said de- 
vice controlled by said adapter to perform said process, 
and for using said protocol to notify said another adapter 
when data representing discrete portions of said data 

io stream is available in said output buffer store; said 
last-mentioned means causing said process to be per- 
formed continuously, until all of the data in said data 
stream has been processed, without intermediate inter- 
ruption of or further instructions from said computer sys- 

15 tern. 

Although bus systems allowing for alternate bus 
mastership by central processors and peripheral devices 
are well known - an example being the Micro Channel 
bus system, the present invention provides adaptation 
20 of devices to autonomously conduct data streaming op- 
erations via such bus systems (Micro Channel is a trade- 
mark of the International Business Machines Corpora- 
tion). 

In at least a preferred embodiment, central proces- 

2S sor systems are adapted to concurrently prepare plural 
such devices (i.e. devices that are adapted for "data 
streaming"), or respective device control units, in ad- 
vance of the actual handling of a data stream, and to ver- 
ify that all of the devices involved are properly prepared 

30 before initiating a data streaming operation between the 
devices. The preparation leaves all of the devices, or re- 
spective device control units, with all of the control infor- 
mation needed to perform respective data streaming 
functions. The control information prepares the control 

35 units and associated devices to cooperatively process 
the entire stream without further assistance from the 
processor (i.e. without timing dependencies associated 
with interruptions of and interventions by the processor 
and associated layers of software in the processor which 

40 are concerned with management of stream processing 
functions). The control units and associated devices may 
be attached to the processor as peripherals or they may 
be virtual components simulated in the processor sub- 
system. 

45 After such preparation, a go-ahead signal is given 
to a device control unit which is the first one scheduled 
to handle the stream of data (retrieving it from a source 
device designated by the control information, and per- 
forming a transforming process on it if instructed to do 

50 SO). 

The units are further provided with logical capabili- 
ties to accomplish their respective data stream process 
ing functions through logical interpretation of the control 
information furnished by the processor, and predeter- 
55 mined reactions to signals received from other units dur- 
ing stream processing (which signals are defined in ad- 
vance by the control information). 

After the go-ahead signal is given the control units 
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, proceed to perform a "data stream" processing ("data 
streaming") operation defined by the control information. 
The data so processed, which may consist of many 
blocks of data, is passed through "block sized" memory 
buffers shared by communicating pairs of control units 
Each buffer may be filled and emptied many times during 
the execution of a single streaming process. The buffers 
are pre-allocated by the processor, but it is up to the de- 
vice control units to properly manage their use. 

Functions defined by the control information which 
prepares these device control units for a data streaming 
process include: 1) the source of the respective device 
control unit's input data; 2) if the source is one or more 
input (memory) buffers shared with a prior unit (i e as- 
signed as output buffers to the prior unit), the policy for 
managing such input buffers (e.g. the size and number 
of these buffers, and their locations in the memory ad- 
dress space of the system if appropriate); 3) the desti- 
nation of data resulting from the respective unit's han- 
dling of the stream; 4) if the destination is an output buffer 
shared with a subsequent unit, the policy for managing 
that buffer; 4) signals or events that will notify the respec- 
tive unit that an input buffer is available for processing; 
5) signals or indications to be generated by the respec- 
tive unit for notifying a prior unit that the respective unit 
has finished processing an input buffer shared with the 
prior unit (i.e. that such buffer is effectively available for 
reuse); 6) signals or indications to be generated for no- 
tifying a next unit that an output buffer is available for 
processing; 7) the operation to be performed by the re- 
spective unit on its source/input data; 8) functions to be 
performed by the respective unit for synchronizing its 
handling of the stream data with handling of data in other 
streams (e.g. for synchronizing the handling of pic- 
ture/video data in one stream with corresponding audio 
data in another stream); and 9) procedures to be used 
by the respective unit for detecting and recovering from 



error. 

Each unit is architected logically to be able to inter- 
pret the control information furnished to it by the proces- 
sor, perform defined stream processing functions, react 
to defined signals from other units and generate defined 
signals to other units. Those skilled in the art will under- 
stand that logical functions for such architecture can be 
easily implemented in otherwise conventional units; and 
they will understand also the performance tradeoffs as- 
sociated with implementing such functions via dedicated 
special purpose logic (e.g. state machines) and general 
purpose logic designed for interpreting microprogram 
type firmware. 

A preferred embodiment of the invention will now be 
described, by way of example only, with reference to the 
accompanying drawings in which: 

Figure 1 is a schematic block diagram of a computer 
system that is used for explaining prior art practice in re- 
gard to functions performed by the central processor and 
peripherals in processing large volumes of data. 

Figure 1a is a schematic timing diagram used to ex- 



plain the sequence of operations conducted by the cen- 
tral processor and peripherals in the scheme depicted in 
Figure 1 . 

Figure 1 B is used to illustrate that the shared mem- 
5 ory data buffer B1 -2 of Figure 1 can have plural partitions 
or sections. 

Figure 2 is a schematic block diagram, similar in for- 
mat to that in Figure 1 but illustrating the signalling func- 
tions of central processor and peripherals in the handling 
to of a data streaming operation in accordance with an em- 
bodiment of the present invention. 

Figure 2a is a timing diagram used to explain the 
sequence of operations performed by processor and pe- 
ripherals in conducting a data streaming operation in ac- 
15 cordance with an embodiment of the present invention. 
Figure 3 is a schematic block diagram illustrating 
use of a surrogate (or virtual) control unit, emulated in a 
central processor subsystem, to interface to control units 
that are not architected for interpreting control informa- 
*> tion in accordance with the invention (e.g. pre-existing 
control units); so that a surrogate unit acting in combina- 
tion with an "unarchitected" control unit appears to func- 
tion as properly architected control unit (relative to other 
control units involved in a streaming operation). 
25 Figure 4 is a schematic block diagram illustrating the 
functional shifting of a stream processing function from 
a peripheral device into a virtual device emulated in the 
central processor subsystem, to have both surrogate 
control and selected stream processing functions per- 
30 formed in the processor subsystem. This type of ar- 
rangement is useful to provide stream processing func- 
tions to users of a computer system at potentially less 
cost (but slower) than could be obtained from devices 
external to their systems, or to provide stream process- 
es ing functions that are not implemented in stand-alone de- 
vices. 

Figure 5 provides a schematic overview of control 
information movement and stream data movement, as 
viewed by a device, and also shows that a single device 
40 may concurrently support processing of multiple data 
streams. This figure is also used to describe how a single 
data stream may be partitioned into multiple streams or 
how multiple streams could be merged into a single 
stream under appropriate circumstances. 
45 Figure 6 is used to explain how multiple data buffers 
shared between a communicating pair of stream 
processing units could be replaced by a single FIFO (first 
in first out) buffer. 

Figure 7 is used to explain how directly communi- 
sm eating stream processing devices can be adapted to use 
a private buffer policy to manage storage of stream data 
passing between them, which can be particularly effec- 
tive when such devices and their shared buffer reside 
physically in a single unit. 
55 Figure 8 summarizes all possible inputs and outputs 
associated with stream processing in accordance with 
this invention. 

Figure 9 illustrates the format of an Open Stream 



4 



7 



EP 0 694 847 A2 



8 



Request block that is an element of control information 
furnished in accordance with this invention. 

Figure 9a shows details of an "open stream param- 
eters" field contained in the Open Stream Request ele- 
ment. 

Figures 10-15 show formats of various descriptor 
sub-fields that can be contained in an "open stream pa- 
rameters" field. Figure 10 shows a "buffer group descrip- 
tor" subfield. Figure 11 shows a "buffer descriptor" sub- 
field. Figure 12 shows a "buffer notification descriptor" 
subfield. Figure 1 3 shows an "input signal code descrip- 
tor" subfield. Figure 14 shows a "synchronization de- 
scriptor" subfield. Figure 1 5 shows a "transform descrip- 
tor" subfield. Parts and functions of these subfields are 
given in the detailed description. 

Figure 16 shows the format of a buffer control re- 
quest element that is part of the control information fur- 
nished in accordance with the invention. 

Figure 16a shows the format of a buffer control pa- 
rameters field contained in the buffer control request el- 
ement. 

Figure 1 7 shows the format of a buffer synchroniza- 
tion control request element that is part of the control in- 
formation of the invention. 

Figure 1 7a shows a "synch control parameters" field 
that is contained in the control element of Figure 17. 

Figure 18 shows the format of a stream control re- 
quest element in accordance with the invention. 

Figure 18a shows details of the stream control pa- 
rameters field contained in the request element of Figure 
18. 

Figures 19a, 19b, and 19c contain a flow diagram 
describing the operations and logical organization of a 
control unit adapted for data streaming in accordance 
with the present invention. 

Figure 20 is a schematic block diagram illustrating 
logical components of a control unit operating in accord- 
ance with the flow diagram of Figures 19a, 19b, 19c. 

Figure 1 -- a schematic of a conventional computer 
system with multimedia capability -- is used to explain 
the "interrupt latency" problem solved by the present in- 
vention. Processor and memory subsystems are shown 
collectively at 1, and designated Processor/Memory 
Subsystem (PSS). Within this subsystem complex a hi- 
erarchy of programming entities is used to control move- 
ment of data between peripheral devices. These entities 
may include a device manager subsystem 2, a stream 
manager subsystem 3, an operating system 4, device 
drivers 5, 6 associated with specific devices, and "rout- 
ers" 7 - 8, for routing signals between the PSS subsys- 
tem and devices. 

Routers 7 - 8 are useful for routing formatted control 
information, between subsystems of a computer system, 
in accordance with Subsystem Control Block (SCB) ar- 
chitecture concepts described in publication "SCB Archi- 
tecture supplement to the IBM Personal System/2 Hard- 
ware Interface Technical Reference Architectures" (Cop- 
yright 1991, International Business Machines Corpora- 



tion) and also in US patent 5325492 by Bonavento et al. 
US 5325492 describes a command delivery mechanism 
which may be used as a component of this embodiment. 
In SCB architecture, varied length control elements with 
5 predetermined formats are passed between client and 
server entities, for defining units of work to be conducted 
by the server entities. In Bonavento et al, the control el- 
ements are routed to pipe configurations of enqueued 
elements, and routers such as those shown here decode 

10 destination codes in each element to route the informa- 
tion to appropriate "pipes". 

Although shown as separate boxes here, to avoid 
obscuring the drawing, these routers actually may be im- 
plemented as a single entity (program module) within a 

is processor subsystem such as PSS. 

An input -output channel, shown at 1 0 : links the PSS 
subsystem to device control units shown generally at 12 
which control respective devices. Two such control units, 
13 and 14, are shown in this figure, along with devices 

20 15 and 16 controlled respectively by unit 13 (CU1) and 
unit 14 (CU2). Channel 10 has a peer communication 
feature enabling control units such as 1 3 and 1 4 to com- 
municate with each other directly (i.e. without interven- 
tion of parts of PSS). A suitable channel facility with a 

25 feature of this kind is the IBM Micro Channel. 

CU1 has an associated router 13a which, when CU1 
is sending control elements to pipes in other parts of the 
system, serves to route such elements to appropriate 
pipe destinations (e.g. parts of PSS and/or other control 

30 units like CU2). Likewise, CU2 has an associated router 
14a directing its control element communications to 
pipes in PSS and in other control units like CU1. 

Devices 15 and 16 are assumed to be involved in 
an operation involving successive processing of large 

3S amounts of data; first by device 15 and then by device 
16. Data buffer 17 (designated B1-2), shared by these 
devices, receives data processed by device 15 and sup- 
plies the data to device 1 6. Preferably, buffer B1 -2 is con- 
tained in the memory subsystem of PSS, but is shown 

40 separately in the present drawings for simplicity (B1-2 
also could be a dedicated memory buffer, used only by 
the devices 15 and 16, without necessarily affecting the 
operation of the present invention). 

As noted above, the peer communication feature of 

45 channel 10 allows control units and other peripheral 
equipment to inter-communicate directly. In such in- 
ter-communication, bus mastership is assumed alter- 
nately by central processor, memory and peripheral sub- 
systems of the computer system. 

50 When peripherals have master control of the bus 

they communicate directly with either the memory sub- 
system, the processor subsystem or other peripherals. 
When the processor controls the bus it communicates 
usually with peripherals and outlying portions of the 

55 memory subsystem. When the memory subsystem con- 
trols the bus, it acts through either a Direct Memory Ac- 
cess (DMA) controller to communicate with devices or 
through a Memory Controller to communicate with out- 
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lying components of the memory subsystem. 

Figure 1A illustrates conventional handling of data 
transfer processes involving movement of a large 
amount of data from device 15/CU1 to B1-2, and from 
B1-2 to device 16/CU2. A large amount of data in the 
present context is an amount which could exceed the ca- 
pacity of B1-2 by several orders of magnitude. 

In this figure, vertical lines 30-32 represent time, in- 
creasing progressively in the downward direction, and 
horizontal lines depict specific actions. Horizontal' lines 
emanating from vertical line 30 (terminating in arrows 
pointing to other vertical lines) depict actions originated 
by PSS. Horizontal lines emanating from vertical line 31 
depict actions originated by CU1 or device 15. Horizontal 
lines emanating from vertical line 32 depict actions con- 
trolled by CU2 or device 1 6. 

As shown at 40, the operation is started by a com- 
mand from PSS to CU1 and device 1 5 directing them to 
fetch a first of n blocks of data from a source designated 
by the command (which could be in the memory subsys- 
tem or in another device such as a CD-ROM), process 
the block and write the result to shared buffer B1-2. 

This is followed by not-shown actions in which the 
commanded operation is performed by CU1 and device 
15. As shown at 41 , when these actions are completed 
(successfully or unsuccessfully), CU1 presents a com- 
pletion interrupt signal to PSS. At some indefinite time 
after receiving this signal (depending upon its current 
task load, etc.), PSS controls the channel to retrieve sta- 
tus information from CU1 and device 15. 

After recovering the status information associated 
with the interrupt received at 41 , and assuming that the 
information indicates successful completion of the oper- 
ation initiated at 40, PSS acts at 42 to command CU2 
and device 1 6 to process the data block placed in B1 -2. 
Then CU2 and device 16 perform a respective process 
and conclude with another completion interrupt signal 
from CU2 to PSS shown at 43. In this process, data is 
read from B1-2, processed, and sent to a destination 
specified in the command given at 42 (either to another 
block of shared memory, to a block of unshared memory, 
or to a specific output device such as a display monitor 
or loudspeaker). After an indeterminate delay following 
receipt of the interrupt signal presented at 43, PSS re- 
covers associated status information from CU2 and de- 
vice 16. 

Assuming this status indicates successful comple- 
tion, the processes just described are repeated relative 
to other blocks of data (second, third, n-1st), one 
block at a time; with this repetition intended to be sug- 
gested by broken vertical lines 44. In a final repetition, 
indicated by horizontal lines 50-53, a last or nth block of 
data is processed by CU1 , written to B1-2 and the result 
processed by CU2 and written to a defined destination. 

It should be appreciated that n can be an unknown 
and very large number, and that the cumulative delays 
associated with the handling of the (2 times n) comple- 
tion interrupts in PSS can be very long. 



Figure 1 B shows that B1-2 can have two or more 
sections. B1-2A, B1-2b. These could be separately filled 
by CUI's device 15 and emptied by CU2's device 16. 
Those skilled in the art will understand that such parti- 
5 tioned buffers are subject to concurrent (although not 
necessarily instantaneously simultaneous) access, for 
enabling devices such as 15 and 16 realize higher data 
throughput; i.e. PSS could initiate an action by CU1 rel- 
ative to B1 -2A while CU2 is performing an operation rel- 
10 ative to data previously placed in B1-2B. Accordingly, 
PSS might not have to wait for completion interrupts and 
status from CU2 before starting the handling of a next 
data block by CU1. 

However, there would still be cumulative delays as- 
15 sociated with the handling by PSS of completion inter- 
rupts from at least CU1, for each block of data proc- 
essed, which would adversely affect the efficiency of the 
entire operation. Also, there would still be the processing 
burden carried by PSS of collecting and analyzing the 
20 block completion status functions which would detract 
from time that PSS otherwise could give to other tasks. 

The present embodiment seeks to eliminate the de- 
lays associated with PSS handling of block completion 
interrupts, as well as to offload from PSS much of the 
25 processing burden associated with its handling of block 
completion interrupts. 

Figure 2 illustrates a system like that in Figure 1, but 
which is adapted for handling data streams (large vol- 
umes of data) through plural devices more efficiently 
30 than the system of Figure 1 . 

In this arrangement, the signalling paths 56 and 57, 
which respectively link the host system PSS to device 
control units CU1 and CU2, are used only to initially pre- 
pare the control units for a data streaming operation that 
35 they are to handle in coordination, and "autonomously" 
(i.e. without interrupting or interacting with PSS after the 
operation is initiated). In that operation, CU1 and CU2 
direct operations of respective devices relative to a 
stream of data with arbitrary length, that data passing 
40 "piecemeal" through a shared buffer B1-2 which could 
not simultaneously hold all of the data. 

The data is processed to conclusion, first by CUVs 
device 1 5 and then by CU2's device 1 6, without interrup- 
tion of PSS. At the conclusion of the streaming operation, 
45 that event and its status are communicated to PSS via 
an interrupt. 

During the operation, CU1 and CU2 use the di- 
rect/peer communication feature of channel 10 to notify 
each other of events pertaining to buffer B1 -2 (e.g. a sec- 
50 tion having data available for further processing by de- 
vice 1 6, or a section becoming available to received data 
from device 15, since its previous data has been read 
and processed by device 16). These notification commu- 
nications, enabling the CU's to coordinate usage of the 
55 buff er sections, can take the form of either formatted con- 
trol elements transferring from a pipe in CU1 to a pipe in 
CU 2, or signals which are directed to a specific register 
in CU2. When the communications are directed to pipes, 
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they are handled through the routers 1 3a and 1 4a. When 
the communications are signals to registers, these rout- 
ers may be bypassed. 

When forwarding control signals to CU2, to indicate 
filling of portions of B1-2 with data, CU1 (or router 13a) 
assumes master control of the bus containing channel 
10 and either directly writes control signals to a register 
in CU2 or routes a formatted control element to a pipe in 
CU2 via router 14a. 

The preperitoneal functions performed by PSS, and 
the streaming operation performed (autonomously) by 
the control units and respective devices, are described 
in a general sense with reference to Figure 2A. Specific 
forms of properitoneal control information furnished by 
PSS to the control units, and of control signals furnished 
by CU1 to CU2, will be described later. 

Figure 2A : like Figure 1A, uses vertical lines to rep- 
resent time and horizontal lines emanating from the ver- 
tical lines to indicate actions performed by PSS and each 
of the control units. 

At 70, PSS provides one oi more commands to CU1 
to prepare the latter for a streaming operation and to de- 
fine the operation (buffer spaces to be used in the mem- 
ory subsystem as a shared data buffer), source of data 
to be retrieved and processed by device 15, etc. At 71, 
PSS receives interruption status from CU1 indicating ei- 
ther that CU1 is ready to begin the streaming operation 
or was unable to complete its preparation. 

At 72, PSS directs one or more commands to CU2 
to prepare it for the same streaming operation and to de- 
fine the operation (buffer space to be used as B1 -2, des- 
tination of data processed by device 1 6, etc.). At 73, PSS 
receives interruption status from CU2 indicating the lat- 
ter's status (ready or unprepared). 

If other control units are involved in the streaming 
operation, they too will receive setup instructions from 
PSS and signal readiness status via interrupts to PSS. 
If any interruption status returned to PSS indicates that 
a control unit is unable to complete preparation for the 
streaming operation, the setup process is aborted and 
the streaming operation is not started. 

The commands used to set up each control unit may 
be provided to the control units via the pipe signalling 
technology disclosed in the application by F. Bonavento 
et al cross-referenced earlier. 

Assuming all control units have indicated ready sta- 
tus, PSS provides a GO signal at 74 to initiate the stream- 
ing operation. This signal is provided only to the control 
un it or units which are required to perform the first actions 
in the streaming operation; in this case, the signal is giv- 
en to CU1 whose device 15 will be required to begin 
fetching data blocks from a designated source, process 
the data and write result data to B1 -2 for further handling 
by device 16 associated with CU2. 

Actions occurring successively, in processing the 
first 6 blocks of data in the streaming operation, are sug- 
gested by horizontal lines 80 through 85; and subse- 
quent actions relative to additional data blocks are sug- 



gested by broken vertical line 86. 

In reference to actions 80-86, it is assumed that 
shared memory buffer B1 -2 contains plural block storage 
sections B1-2A, B1-2B, etc. (see Figure 1B). 
s At 80, CU1 signals CU2 to indicate availability of a 
first block of data in portion B1-2A of shared memory 
buffer B1-2 (it being understood that prior to this signal 
device 15 associated with CU1 has processed a corre- 
sponding first block of data and written the result block 
10 to B 1-2 A) 

At 81 , CU1 signals availability of a second block of 
data in portion B1-2B of B1-2 (with the implication that 
prior to this signal such data has been written to B1 -2B 
by device 15). At 82-86, CU1 signals availability of third, 
15 fourth, .... blocks of data alternately in B1-2Aand B1-2B. 
The signals given at 80-86 may be conveyed either 
in the pipe form taught in the cross-referenced applica- 
tion by F. Bonavento et al or as direct signals( instantly 
decoded by CU2), depending upon time constraints on 
the actions required to be performed by CU2 and its de- 
vice 16. 

After each signal indication 80-86, CU2 is responsi- 
ble for controlling device 1 6 to read the associated block 
of data from the designated portion of B1-2 5 process it 
and transmit the result data to a destination defined in 
the initial preparation of CU2. Optionally, depending 
upon time constraints imposed on CU2 and device 16, 
CU2 may be required to return signals to CU1 as each 
portion of B1-2 is emptied by actions of device 16. 

Throughout all of the actions 80 through 86, CU1 , 
CU2 and respective devices act autonomously (without 
interrupting PSS or receiving further guidance or control 
from that system). 

After a last data block has been processed by device 
1 5 (which may be determined by that device from signals 
appended to the end of that block at the source or from 
a count function provided at initial preparation of CU1, 
etc.) CU provides a completion interrupt signal to PSS 
(action 87), enabling PSS to subsequently recover com- 
pletion status from CU1 and device 15 as well as from 
CU2 and device 16. Optionally, CU2 may be required to 
provide a separate completion interrupt to PSS when its 
device 16 concludes its assigned operations. 

From what has been indicated so far, it should be 
apparent that, in the present embodiment, control units 
participating in the streaming actions described must be 
logically equipped to be set up by a host system PSS, 
and, after initiation of at least a first device by that sys- 
tem, such units must be adapted to carry out the signal- 
ling functions required relative to other control units co- 
operating in the streaming process without further input 
from the host system. In some instances, users lacking 
such device control units may desire to have their func- 
tions emulated in the host system. The arrangement 
shown in Figure 3 illustrates this point. 

Device control units 90, 91 , and 92, along with re- 
spective routers 90a, 91a and 92a, and devices 90b, 91b 
and 92b, are supposed to be sequentially involved in a 
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streaming operation. In that operation, devices 90b and 
91 b will share memory data buffer 93 (B1 -2), and devices 
91b and 92ba will share memory data buffer 94 (B2-3). 
However, assume that control unit 91 lacks the logical 
capabilities for interpreting setup commands furnished 
by PSS, and of acting autonomously relative to the other 
two control units in respect to the streaming process per 
se. 

In that event, a simulated or surrogate control unit 
95 (CU2s), provided as a program module in PSS, would 
receive initial setup commands from PSS, and cooperate 
with control units 90, 91 and 92 to carry out the autono- 
mous control aspects of the streaming operation that 
control unit 91 itself is unable to perform. 

During the setup part of the process, control units 
90 and 92 receive appropriate setup commands and re- 
turn readiness indications via respective signal paths 96 
and 97; and surrogate control unit 95 receives its com- 
mands and returns a readiness indication via the path 
98. It should be apparent then that the physically real 
control units 90 and 92 are initialized via the channel 1 0, 
and surrogate control unit 95 receives its commands by 
a process that is wholly internal to the PSS complex, de- 
termines its "readiness" by communicating with control 
unit 91, router 91 a, and device 91b through the channel, 
and then reports its readiness status by an interruption 
process wholly internal to the PSS complex. In determin- 
ing readiness, surrogate unit 95 communicates with con- 
trol unit 91 via signal path 99 and channel 10 

When all of the control units are ready, PSS initiates 
the streaming operation by means of a GO signal to the 
first control unit 90 (CU1) and device 90b begins 
processing blocks of data fetched from a designated 
source and writing result data to portions of buffer B1 -2. 
As each buffer portion becomes full, control unit 90 is- 
sues a DATA AVAILABLE communication (see Figure 
2A) to notify surrogate control unit 95 of this event. The 
notification is in the form of a formatted SCB element that 
is directed by router 90a to a pipe in PSS which is as- 
signed to surrogate control unit 95; i.e. the information 
in this notification is conveyed over signal path 100 to 
surrogate control unit 95. 

For each such notification, surrogate control unit 95 
communicates with control unit 91 to set up a conven- 
tional command in the latter for having device 91b proc- 
ess a block of data in a specified respective portion of 
buffer 93, and transfer result data to a specific portion of 
buffer 94 that is shared by devices 91 b and 92ba. 

As device 91b finishes handling each such data 
block, control unit 95 receives a completion indication 
from control unit 91 via path 99 (via an interrupt or direct 
signalling process), and immediately presents a DATA 
AVAILABLE signal to control unit 92, via path 101 
through channel 10. The last mentioned signal causes 
control unit 92 to initiate processing of the respective 
data block in the autonomous manner described previ- 
ously. 

The amount of program code required to implement 



such surrogate control components is not large, and 
since the code could easily be adapted to serve multiple 
devices (e.g. by a "front end" segment common to a class 
of devices and plural "back end" segments tailored to 
* specific device drivers), it could be an attractive commer- 
cial resource to offer to system users. 

Figure 4 illustrates how the arrangement of Figure 
3 can be further modified to shift all device and device 
control functions associated with one device into a virtual 
10 device/control unit program element of PSS. 

The arrangement of Figure 4 is functionally the same 
as that in Figure 3. However, in Figure 4, the control unit 
91 is wholly integrated into the surrogate controller 
shown as element 95 in Figure 3 (i.e. in Figure 4, the 
15 entire control unit 91 is implemented as software routines 
executable in PSS), and device 91a in Figure 4 is also 
implemented entirely by routines executable in PSS. 

The operation of the arrangement in Figure 4 is ba- 
sically the same as the one in Figure 3, except that com- 
20 munications between control unit 91 and device 91 a are 
conducted as internal functions of PSS (they do not go 
through the channel 10) and the program modules rep- 
resenting unit 91 can be organized for fully autonomous 
streaming operation (i.e. it communicates only with units 
2S 90 and 92 during a streaming operation and need not 
furnish status to e.g. the streaming manager in PSS until 
the entire operation is completed (or aborted). 

Figure 5 provides an overview of control signal and 
data movement as viewed by a single device and device 
30 control unit. In addition, this figure shows that one control 
unit and device can be used to sustain multiple streaming 
operations concurrently. Although not shown in this fig- 
ure, it will be readily understood that several streams 
could be combined into one stream, or one stream could 
3S be broken up into several streams depending upon the 
processing functions performed.by the device relative to 
such streams. 

Device controller 1 20 interacts with data buffer man- 
agement facility 121 to control one or more devices 122 
40 for processing three data streams identified as streams 
1-3 in the figure. Data contained in these streams is 
transferred to the device 122 from input buffers 124-126 
that may be part of PSS memory, and that may be shared 
between device 122 and an "upstream" device that 
45 writes the data to the buffers. Data resulting from oper- 
ations of device 122arewritten to output buffers 127-129 
that may be shared with a "downstream" device required 
to handle the data generated by device 122. 

In this figure, stream 1 passes through input buffer 
50 1 24 and output buffer 1 27; stream 2 passes through in- 
put buffer 1 25 and output buffer 1 28; and stream 3 pass- 
es through input buffer 126 and output buffer 129. 

With respect to these streams, controller 120 is of 
course prepared by setup command information re- 
55 ceived from PSS. Controller 120 also receives input con- 
trol functions at 130, from not-shown upstream control 
unit(s), and supplies output control functions at 131 to 
not-shown downstream control unit(s). 
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As will be shown later, the set up commands may 
be formatted in accordance with the now-published sub- 
system control block (SCB) architecture mentioned ear- 
lier; and these commands typically would include at least 
commands to "open" a stream (i.e. prepare for a new 5 
streaming operation), commands to "suspend" or "stop" 
a stream (e.g. to allow for a user to interject a pause in 
or completely halt a motion picture presentation), and 
commands to "resume 0 a previously suspended or 
stopped stream operation. 

The controller 120 and facility 121 may be integral 
parts of a single control unit or device adapter entity. 

Communications between the illustrated arrange- 
ment and control units upstream and downstream of that 
arrangement are carried out in a manner such that the 
upstream and downstream units are unaware that they 
may be communicating with virtual devices implemented 
in host system routines. 

Figure 6 shows that the buffer shared by two devic- 
es, devices A and B respectively shown at 1 38 and 1 39, 
may be a FIFO (first in first out) memory arrangement as 
suggested at 140. An advantage of this type of arrange- 
ment is that it eliminates the need for passage of control 
information between the controller of source device A 
and the controller of destination device B; inasmuch as 
control is implicit in this kind of arrangement (i.e. it is as- 
sumed that the buffer is always capable of receiving da- 
ta, and therefore device B is required to process data (in 
first in first out sequence) whenever the buffer is not ex- 
plicitly empty. A disadvantage is that the buffer could be 
overrun without the source device or its controller receiv- 
ing any indication of that occurrence. 

The FIFO arrangement could be viewed as a spe- 
cies of the buffers described in earlier figures, wherein 
the buffer is one unit in length (the width of the FIFO) and 
effectively wraps to itself. If the data transfers to the FIFO 
occur in bursts with automatic address incrementing, 
special care must be taken to ensure that enough capac- 
ity and continuity of addressing is provided in the FIFO 
to avoid the possibility of addressing memory not part of 
the shared buffer. 

Figure 7 shows source and destination devices A 
and B, at 144 and 145 respectively, sharing a private 
buffer 146; typically a buffer not allocatable to other de- 
vices and preferably a buffer so situated that data is com- 
municated between it and the devices without crossing 
the channel (reference channel 10, Fig. 2). In this type 
of arrangement, the devices have a 'private" permanent 
understanding or protocol in regard to the order in which 
segments or block portions of the buffer are filled and 
emptied, so that there is no need for passage of control 
information from source to destination in order to indicate 
the location of the portion most recently filled. 

Figure 8 provides a summary view of all possible in- 
puts and outputs (control and data) described in previous 
sections. Types of possible input and output buffers are 
indicated respectively at 1 48 and 1 49. In order to ensure 
proper movement of data between devices sharing a 




buffer a "lowest common denominator" must be. agreed 
to and architected for all devices and associated control 
units. 

A likely choice for buffer configuration would be a 
simple buffer, in shared system memory, having two por- 
tions that are utilized in a "ping pong" fashion (i.e. the 
source filling the sections alternately and the destination 
reading them.in the same sequence). The decision as to 
which type of buffer to use and the type of control infor- 
mation that should be passed between source and des- 
tination should be made by the Stream Manager using 
information available to the system when devices are at- 
tached to it as to the capabilities of the devices and their 
control units. 

The commands (request type control elements) 
used for setting up the present streaming operations, 
and descriptor information contained in such requests, 
is shown in Figures 9-18. These requests have a sub- 
system control block (SCB) architected format similar to 
what has been described in the above referenced patent 
application by F. Bonavento et al and the published SCB 
Architecture document identified earlier. However, the in- 
formation content of these objects as used for setting up 
streaming processes is unique. 

Request control elements are one species of SCB 
architected forms. Other control elements are reply type 
elements, event type elements and error type elements. 
Requests are sent from a client/source to a server/des- 
tination defining performance of a unit of work. Replies 
are returned by servers in response to certain types of 
requests. Event (notification) elements furnish informa- 
tion about the progress of requested work, the state of a 
request, or the status of a client or server Error type el- 
ements provide error information about requests or 
about status of a server. 

Request elements are used presently to set up 
streaming operations, and event elements may be used 
presently in notification communications that pass be- 
tween control units during the performance of streaming 
operations. 

The requests employed presently to set up stream- 
ing are labelled: OPEN STREAM, CONTROL, BUFFER 
CONTROL, and BUFFER SYNCHRONIZATION CON- 
TROL. 

The OPEN STREAM request format is shown in Fig- 
ures 9 and 9a, and formats of descriptor information fur- 
nished with this request are shown in Figures 10-15. the 
BUFFER CONTROL request format is shown in Figures 
16 and 16a. The BUFFER SYNCHRONIZATION CON- 
TROL request format is shown in Figures 17 and 17a. 
The STREAM CONTROL request format is shown in Fig- 
ures 18 and 18a. 

The format of an OPEN STREAM request control 
element is shown in Figures 9 and 9a. This request con- 
tains a number of information fields 160-167 described 
below. 

Field 160 - contains format identity (Format ID) in- 
formation serving to identify the type of control element. 
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Field 1 61 - contains length information defining the 
length of the request in bytes. 

Field 162 - contains eight discrete subfields- 

A i»m» t r ?, EQ (Request) " defines type of control 
element (in this case, a request type); 

»ih-tK *u S , ( " SUppress re P'y") - is a bit indicating 
whether the client wants the server to return a reply at 
successful completion of requested work; 
lin . h # C ( Hchai ning M ) - a bit indicating a chaining 
linkage between two or more control elements which rep 
resent a single unit of work to be processed in the order 
of their appearance; 

I ("indirect") - a bit (valid only in request type 
control elements) for indicating whether the parameters 
(or value) field discussed below contains a direct repre- 
sentation of information to be interpreted or pointers to 
memory locations of such information; 

N ("notification bit") - (valid only in request el- 
ements) indicating whether the client has or has not re- 
quested notification by the server when processing of the 
respective request element begins; 

W (-waif) - bit (valid only in request type el- 
ements) indicating if the server is to wait, before process- 
ing the respective control element, until the client furnish- 
es a specific "resume" notification; 

E ("expedite") - bit which when active indi- 
cates that the respective control element is to be handled 
as soon as possible (possibly before other control ele- 
ments not containing an "expedite" indication); 

OpenStream - (the function code for an 
OPEN STREAM control element) defines how the pa- 
rameters field (discussed below) of this request is to be 
interpreted (other requests and control elements have 
different function codes); 

Field 163 - is resen/ed (e.g. for future expansion of 
functions). 

Field 1 64 - defines the source of the command as- 
sociated with this request (e.g. the client). 

Field 165 - defines the destination of the request 
(i.e. the pipe or other server entity to which the request 
is to be routed). 

Field 1 66 - contains a correlation field used for cor- 
relating request and reply control elements. 

Field 167 - is a variable length parameters (also 
called "values") field, containing a variable number of de- 
scriptors. The descriptors are used presently to define: 

1) individual buffers that make up a buffer group (a 
group of shared input or output buffers) 
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2) the buffer management policy (how the buffers 
are to be managed by CU's that control sharing 
devices). 

3) the notification policy of each (input and output) 
buffer (i.e. the CU's or other entities, if any, that are 
to be notified when the respective buffer contains 
data available to be processed or when the respec- 
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live buffer is available for refilling with new data 

etc.). 

4) the buffer synchronization policy; i.e. events, pos- 
sibly in the handling of a different stream, or other 
condrtions (in addition to an availability notification 
from an "upstream" CU), that are to trigger process- 
ing of data in a buffer. 

5) the correlation between input and output data 
handled by the respective device (i.e. the transfor- 
mation process, if any, to be performed on the input 
data by the device reading that data). 

The descriptor formats are shown in Figure 9a Each 
descriptor contains sub-fields 169-172 used as follows 
Subfield 1 69 - contains information defining the de- 

senptortype (see discussions of Figures 1 0-1 5 to follow)- 
Subfield 170 - contains information defining the 

length of the respective descriptor (e.g in bytes) 
Subfield 171 -is reserved; 

Subfield 1 72 - contains the descriptor information 
(the .nformation specific to and dependent on the respec- 
tive descriptor). 

The type and length subfields are unique for different 

SmI™^ ^ nUmb9r ° f de *criptor S in any 
STREAM request is variable (depends on the 
number of buffers defined, the number of notifications 
required for each buffer fill/empty event, and the type of 
signalling to be used for notification). 

The types of descriptors which may be provided in 
such requests are: a Buffer Group descriptor (shown in 
Hgure 10), a Buffer descriptor (Figure 11), a Buffer No- 
tif.cat.on descriptor (Figure 12), an Input Signal Code de- 
scriptor (Figure 1 3), a Synchronization descriptor (Figure 
14), and a Transform descriptor (Figure 15). 

The order of descriptors in the Parameters Field 167 
must adhere to a predefined rule so as to facilitate pars- 
ing of the subfields by the device. An appropriate set of 
rules is: 

A) a Buffer Group descriptor must be followed by at 
least one Buffer descriptor; B) a Buffer descriptor 
may be followed by one or more buffer notification 
descriptors; 

C) an Input Buffer group (if present) must be defined 
before an Output Buffer group (if present); 

D) all Input Signal Code descriptors (if present) must 
follow Output Buffer Group descriptors; 

E) a Synchronization descriptor (if present) must fol- 
low the Input Signal Code descriptor; 

F) a Transform descriptor (if present) must follow the - 
Synchronization descriptor. 
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The Buffer Group descriptor (Figure 10) is used to 
define a group of buffers which are to be used and man- 
aged collectively as a shared input or output buffer (each 
single buffer or group component part serving e.g. to hold 
a block of data, and the parts collectively being filled or 
emptied in some predetermined order). The information 
fields contained in this type of descriptor (Figure 10) are: 

Byte 0-1 : x'010C (the code identifying this type of 
descriptor); 

Byte 2-3: reserved; 

Byte 4-5: identity (ID) of a respective Buffer Group; 
Byte 6-7: reserved; 

Byte 8: number of buffers in the group; 
Byte 9: flags for: 

Input/Output control 

Buffer Management Policy (Circular, FIFO, 
private, etc.) 

error reporting policies; 
error recovery policies; 
Byte 10: Relative Stream Priority (the processing 
priority of a stream flowing through this buffer group over 
other streams); 

Byte 11 : Reserved. 
The Buffer descriptor (Figure 11) is used to define a 
Buffer that is a component part of a Buffer Group. This 
dosenptor contains: 

Byte 0-1: x'0214' (the code value specific to this 
tyoc descriptor): 

Ryto 2-3 reserved 

Ryto 4-5 Buffer Group ID (see above); 

Byte 6-7 Buffer ID (identity of the particular buffer 
dcscibcd in this descriptor): 

Byte 8- 1 1 : buffer address (32 bits defining an initial 
location for this buffer in the memory address space of 
the system). 

Byte 12-15: buffer length (in bytes); 

Byte 16: Flags for: 

Input/Output control; 

Notification buffer full (output buffer only); 

Wait for buffer to empty (output buffer only); 

Notification buffer empty (input only); 

Wait for buffer to fill (input only); 
Byte 17-19: reserved 
The Buffer Notification descriptor (Figure 12) de- 
fines which devices to notify when a buffer reaches a 
boundary condition (full, representing data available to 
be processed, or empty, representing that all data in the 
buffer Uhs been processed). Elements of this descriptor 
are: 

Byte 0-1 : x'030C (the code uniquely identifying this 
type of descriptor); 

Byte 2-3: reserved; 

Byte 4-5: Buffer Group ID; 

Byte 6-7: Buffer ID; 

Byte 8-9: Flags for: 

Bit 0 - all buffers/Buff ID only (indication that 
notification should occur for all buffers in the group as 
opposed to only a single particular buffer in a group); 



Bit 1 - Signal/Event (indicates if notification 
should be in the form of a signal (e.g. a communication 
directly addressed to a register in the destination CU) or 
an SCB formatted event control element; 
5 Bit 2 - Notify on buffer full; 

Bit 3 - Notify on buffer empty; 
Bit 4 - Notify on error (recoverable); 
Bit 5 - Notify on error (non -recoverable); 
Byte 10: (if applicable) indicates a Signal Code to 
10 be used when notifying the other unit via a directed sig- 
nal; or, the unit address (destination) to use to send an 
event if Bit 1 is set to "event". 

Byte 11: I/O Port Address (the address in system 
I/O space of the specific register or other entity to which 
15 a notification signal is to be directed, when such signal- 
ling is applicable) or, the entity address (destination) to 
use to send an event if Bit 1 is set to "event". 

The Input Signal Code descriptor (Figure 1 3) defines 
the signal codes that are to be received by the device to 
which the descriptor is directed. The contents of this de- 
scriptor are: 

Byte 0-1 : x'040C (the code value uniquely identi- 
fying this type of descriptor); 
Byte 2-3: reserved; 
Byte 4-5: Buffer Group ID; 
Byte 6-7: Buffer ID; 
Byte 8: Flags for: 

Bit 0 - all buffers ID only (see previous defi- 
nition of this); 

Bit 1 - to indicate Output Buffer empty; 
Bit 2 - to indicate Input Buffer full; 
Byte 9: reserved; 

Byte 10: Signal Code (for indicating a signal code 
to be used for direct signalling notification, when appli- 
cable); 

Byte 11: I/O Port Address( in system I/O address 
space of register or other entity to receive a signal noti- 
fication, when applicable). 

The Synchronization descriptor (Figure 14) defines 
how the respective Buffer Group of the targeted device 
is to be synchronized with other streams (e.g. how a Buff- 
er Group processing a video stream is to be synchro- 
nized with the separate handling of an audio stream) or 
timers. Contents of this descriptor are: 

Byte 0-1 : x'051 0' (the code uniquely identifying this 
type of descriptor); 

Byte 2-3: reserved; 
Byte 4-5: Buffer Group ID; 
Byte 6-7: reserved; 
Byte 8: Flags for: 

No Synchronization (Sync); 
Sync Source is in stream; 
Sync Source is timer; 

Sync associated with pre-arranged deliv- 
ery/consumption rate; 

Byte 9: defines delivery/consumption rate (see last 
flag above); 

Byte 10-11: reserved; 
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Byte 12-15: Stream ID or Timer Address (used in 
conjunction with flags to locate the synch source- i e the 
source of timed functions defining the pace at which input 
data is to be processed). 

The Transform descriptor (Figure 1 5) defines the re- 
lationship between input and output data to be handled 
by the device to which the descriptor is directed (i e the 
process, if any, to be performed by the device on the in- 
put data it receives). Contents of this descriptor are- 

this de'scrip^! 06 ' C ° de Va,U6 UniqUelV identifVin9 
Byte 1: length of descriptor (in bytes) - 
Byte 2-3: reserved; 

Byte 4-7: Stream Correlation ID (used to identify 
the function determining synchronization; e g other 
stream, etc.); a 

Byte 7-x: device dependent control information (x 
= variable number) including: 

Read and Write type commands The 
change relative to similarly formatted control elements 
. °f other descriptors is to allow source and destination 
addresses in this area to specify a Buffer Group ID rath- 
er than a memory address representing the physical lo- 
cation of a shared buffer. 

The Buffer Control Request element (Figures 16 and 
16a) is used in request, reply and error control. It con- 
a.ns the parameters needed to control filling and emp- 
tying of buffers within a Buffer Group. Component fields 
of this request are indicated in Figure 16, and component 
subfields of the "Parameters' field of this request are 
shown in Figure 16a. 

The fields other than the "BufferControl" and "Pa- 
rameters" field in this request have functions and Posi- 
tions with.n the request that are substantially identical to 
those of correspondingly labelled fields in the OPEN 
STREAM request (Figure g). The "Buffer Control" field 
contains a code which distinguishes the request as being 
a Buffer Control type request. The "Parameters" field in 
the Buffer Control Request contains the followinq infor- 
mation: 

Byte 0-1: Buffer Group ID; 
Byte 2-3: Buffer ID; 
Byte 4: Flags: 

Bit 0 - indicating Output Buffer empty; 

Bit 1 - indicating Input Buffer full; 

Bit 2 - indicating Output Buffer error (recov- 
erable); 

Bit 3 - indicating Output Buffer error (non-re- 
coverable); 

Bit 4 - indicating Input Buffer error (recover- 
able); 

Bit 5 - indicating Input Buffer error (nonrecov- 

erable); 

Byte 5-7: reserved; 

Byte 8-11: Error Code (Bit 0 distinguishing between 
recoverable and non- recoverable errors); 

Byte 12-15: Residual Byte Count (for indicating the 
amount of data yet to be processed as a result of an er- 



ror); only valid in error conditions and should have a zero 
value during normal operations; 

Byte 1 6: device dependent (for indicating e g ad- 
ditional status, error or other). 
5 / K B ^ er S y cnronisat i°n Control request element 
(shown in Figures 17 and 17a), like the Buffer Control 
request element described in the preceding section is 
used in request, reply and error control situations. Itcon- 
io T7 ,nf ° rmatlon needed to control synchronization of 
« buffers within a Buffer Group. Component fields of this 
request are shown in Figure 17, and subfields of the re- 
spective Parameters component field are shown in Fig- 
ure 1 7a. Except for the fields labelled "SyncControP and 
Parameters", all other component fields of the Buffer 
Synchronization Control Request, are essentially identi- 
cal to correspondingly labelled (and positioned) fields in 
he OPEN STREAM and Buffer Control requests The 
field labelled "SyncControP contains a code distinguish- 
mg this request as a Buffer Synchronization Control type 
20 request. /K 

The component subfields of the Parameters field in 

17a) are 6 ' SynChr ° nization Contro1 Re quest (Figure 

Byte 0-1: Buffer Group ID; 

25 Byte 2-3: reserved; 

Byte 4: Flags for: 

indicating sync to timer; 

indicating sync to stream per se; 

indicating sync to consumption/delivery rate 
30 specified in byte 5; 

Byte 5: consumption/delivery rate; 
Byte 6-7: reserved; 

Byte 8-11: Timer address or Stream Correlation I D 
The Stream Control Request is also used in request 
reply and error control situations. It contains information 
needed to control stream processing. Component fields 
of this request (Figure 18), other than the respective 
fields labelled "StreamControl" and "Parameters" are 
identical to correspondingly labelled fields in the other 
requests described above. The field labelled "Stream- 
Control" contains a code distinguishing the request as a 
btream Control type request. The field labelled "Param- 
eters" (Figure 18a), in the Stream Control type request 
contains the following subfields: 
45 Byte 0-3: Stream Correlation ID; 

Byte 4: Stream Command with bits designating 
functions to be performed immediately by the targeted ' 
device and controller. 

Prime stre arn (fill buffers but don't begin 
50 processing); y 

Start Stream (begin processing stream data 

in buffers); 

Suspend Stream (suspend processing of 
data in buffers); 

Resume Stream (resume processinq after 
suspension of processing); 

Stop Stream (same as Suspend and Flush)- 
Flush Stream (empty buffers without 
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processing the data); 

Byte 5: Synch Flags: 

Bit 0 - indication to begin immediately; 

Bit 1 - begin when Timer value = x; 

Bit 2 - begin when Input Buffer is full; 5 
Byte 6-7: reserved; 

Byte 8-1 1 : address of Timer value "x" (see byte 5); 

Byte 12-15: current timer value; 

Bytes 16-xx: optional Transform descriptor (see 
Figure 15); "xx" variable. w 

Figures 19a, 19b, and 19c contain parts of a flow 
diagram intended to describe the logical organization of 
device control units that are adapted in accordance with 
the invention for carrying out streaming processes. Fig- 
ure 20 is a block diagram intended to show logical ele- is 
ments needed for streaming in a broad "means plus 
function" context. 

Connections between Figures 1 9a, 1 9b and 1 9c are 
indicated by letters "a", "b" and "c" enclosed in circles. 
Thus circled "a" in Figures 1 9a and 1 9b indicate that an 20 
output of the flow segment shown in Figure 19a links to 
an input of the flow segment shown in Figure 19b. Like- 
wise, circled "b" indicates that an output of the flow seg- 
ment in Figure 1 9c links to an input of the flow segment 
in Figure 1 9a. Likewise, circled "c" indicates that an out- 2s 
put of the flow segment in Figure 1 9b links to an input of 
the flow segment in Figure 19c. 

The setup phase of the streaming process, as 
viewed by a device control unit, is shown in Figure 1 9a. 
At stage 240 of this process, the control unit receives 30 
requests and descriptors of the type described above, 
and sets itself to a working configuration defined by these 
functions. The working configuration includes parame- 
ters defining the buffer policies required relative to input 
data and output data, synchronization policies if re- 35 
quired, and notification policies; and conditioning of logic 
in the control unit to conform to policies defined by these 
parameters. 

As part of this preperitoneal phase, at step 241 , the 
control unit conditions its logic to operate with an input 40 
buffer group having a variable number of buffers defined 
by value P max , and with an output buffer group having a 
variable number of buffers defined by value Q max . The 
number of buffers in each group (i.e., the values of P max 
and Q max ), and sizes of individual buffers in each group, 45 
are defined by information contained in the descriptors 
received at stage 240. The subscript "max" is a value 
defining the number of buffers allocated by PSS for each 
group. It is not meant to connote a "maximum" in the con- 
text of for instance defining an upper limit on the number so 
of buffers which could be allocated to a group (although 
practical circumstances may impose such a limitation on 
PSS). 

Next, at step 242, the control unit sets values of 
counting functions P and Q, which respectively point to 55 
the next input buffer to be processed and the next output 
buffer to be filled, to initial values 1 (effectively pointing 
to specific "first" buffers in the input and output buffer 



groups). 

Before advancing to the decision function shown at 
243, the control unit signals its status to the processor 
system (PSS) via interruption. If this status indicates that 
the control unit is unable to proceed due to error, the 
process of preparing and initiating the streaming opera- 
tion is discontinued by PSS (see earlier comments, in 
the description of Figure 2A, regarding how status inter- 
ruptions affect initiation of the streaming operation). 

At 243, the control unit determines if the signal to 
begin stream processing has been received from its host 
system PSS (e.g. the GO signal from PSS mentioned 
earlier, or its equivalent in a request calling for immediate 
resumption of a suspended stream processing opera- 
tion). When that signal is received, the process advances 
to the segment shown in Figure 19b (via link "circled a"); 
and if the signal has not been received the unit waits a 
Predetermined time (step 244) and repeats determina- 
tion 243. 

In the next segment of the streaming process depict- 
ed in Figure 1 9b, the control unit determines first, at 245, 
if the source of input data for its device is an Input Buffer 
shared with another (upstream) device or a specific other 
device (such as CD-ROM, tape, hard disk, network port, 
etc.). 

If the source is not an Input Buffer, the respective 
device is prompted, at 246, to read data from the specific 
source device. When this action is taken, a determination 
is made at 247 of whether the data retrieved from the 
source needs specific process handling or is merely be- 
ing forwarded to a downstream device. If specific trans- 
form/process handling is required, actions 248 are taken 
to carry out the process (which is defined by one of the 
requests received at set up phase, Figure 1 9a), and the 
segment is exited to a continuing segment in Figure 1 9c, 
via "circled c". If the determination at 247 is that no trans- 
formational processing of the data is required, actions 
248 are skipped and the segment exits to the segment 
of Figure 19c. 

If the determination at 245 is that the source of input 
data is an input buffer (i.e. a buffer shared with an up- 
stream device), a determination is made at 250 of which 
buffer (in a buffer group) to process next and the availa- 
bility status of that buffer (see discussion below, in de- 
scription of Figure 19C, of how the counter P is used). 

If the input buffer is not available at determination 
250, that determination is repeated after a predeter- 
mined wait time. If the input buffer contains available da- 
ta, determination 251 is made to determine if the data in 
the buffer needs process/transformation handling or sim- 
ple buffered handling. 

If the determination at 251 is that process handling 
is required, the device is prompted to perform a respec : 
tive process (defined in the set up requests) at 252, and 
the segment continues with further actions 253 and 254. 
If the determination at 251 is that no transformational 
processing is needed, action 252 is skipped and the seg- 
ment advances directly to actions 253 and 254. 
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At action 253, a determination is made as to whether 
the current state of the input buffer (e.g. buffer "empty" 
or available for refilling) requires notification of other par- 
ties/device control units. If notification is required, ac- 
tions 254 are taken to carry out the notifications and the s 
segment exits via "circled c" to the continuing segment 
of Figure 19c. If notification is not required, actions 254 
are skipped and the segment exits directly to the seg- 
ment of Figure 1 9c via "circled c". 

Upon entering the operational segment shown in 10 
Figure 1 9c, determination 260 is made to determine the 
destination of data produced in the segment of Figure 
1 9b; as either a (shared) Output Buffer or a specific de- 
vice (monitor, loudspeaker, etc.). 

If the destination is a specific device, action 261 is 15 
taken, to forward the data to that device, followed by se- 
lected parts of an action routine indicated at 262 to 267 
(explained below), and, when all of the output data has 
been handled in this manner, followed by re-entry to ac- 
tion slage 243 in the setup segment of Figure 19a : via 20 
the "circled b" linkage. 

If the destination of the output data is a specific out- 
put buffer, action 270 is performed to write the data to 
that buffer. This is followed by actions 271 and 272 lead- 
ing to the actions 262 to 267 mentioned above. In action 25 
271 a dotormination is made as to whether any parties 
require notification. If notification is required, action 272 
is performed to accomplish the notification. If notification 
is not required action 272 is skipped and the segment 
advances directly to action set 262 to 267. 30 

At 262. the value of the count function P. designating 
the Input Buffer from which data is currently being read, 
is compared to the maximum value P max established in 
actions 241 (Fig. 19a). If the value of P is less than that 
01 p rra* tnG value of P is incremented by 1 (action 263). 35 
If the value of P is equal to P max , the value of P is reset 
to 1 (acton 264) to begin reading data from the first input 
buffer again. 

At 265 the value of Q, designating the Output Buffer 
currently being filled, is compared to the value Q max de- 40 
fining the total number of output buffers currently being 
used If Q is less than Q max , Q is incremented by 1 (ac- 
tion 266) if Q is equal to Q max , Q is reset to the value 1 
to begin the refilling of the first output buffer. 

In all of the foregoing operations, the following 
should be understood. Actions requiring notification of 
other parties (device controllers) are conducted through 
the channel 10 (Figure 1). This requires the control unit 
initiating such action to arbitrate for access to the chan- 
nel, gain master control of the bus containing the chan- so 
nel, and use the channel to convey the notification infor- 
mation to the other party. The notification information 
may bo formed as directly interpreted signals placed in 
an addressable register (in the control unit being noti- 
fied), via the peer communication feature of the channel, ss 
or it may be formed as an SCB event control element 
(recall earlier discussion) which is sent to a pipe feeding 
another control unit. 



The pipe itself can be located in a buffer (separate 
from the shared data buffers) in system/PSS memory or 
in a buffer memory integral to the other control unit that 
it feeds. The router in (or associated with) the control unit 
initiating the action and determines the physical route for 
the communication (system memory route or peer com- 
munication route to an address in an integral buffer). 

An interesting observation or aspect, in regard to 
what has been described, is that the specific transforma- 
tion process performed by any device on the data stream 
has no effect on any other device processing the same 
stream. All of the actions required to manage the stream 
flow through the shared buffers, and where necessary to 
synchronize the processing of input data to external tim- 
er events or the handling of another data stream, are 
controlled by the control units in a manner which is ef- 
fectively transparent to the devices receiving input data. 
Thus, such devices can have relatively standard con- 
struction and new devices to handle transformation func- 
tions that do not exist today can easily be developed 
without regard to how such functions affect any other as- 
pect of the stream process. 

Figure 20 indicates the logical organization of a con- 
trol unit (for autonomous stream processing in accord- 
ance with this invention) in terms of means provided for 
accomplishing the functions effectively described in Fig- 
ures 19a-19c. 

As indicated at 290, the control unit requires means 
to receive from PSS the request elements defining the 
streaming process. 

As shown at 291 the control unit requires means re- 
sponsive to the request elements furnished during setup 
to prepare the respective unit for the streaming operation 
(establish register conditions needed for the operation, 
test availability of paths to specified input and output buff- 
ers, etc.). 

Means shown at 292 enables the control unit to in- 
dicate its readiness or error state to PSS. 

Means shown at 293 is conditioned logically by the 
initiating signal from the host (GO signal or stream con- 
trol request with immediate resume function), and the 
conditions established during setup, to start and contin- 
ue the streaming process in an autonomous manner (i. e. 
potentially without further input from the host system 
PSS until all of the data to be processed has been proc- 
essed). Naturally, this last means includes means for 
carrying out notification functions specified in Notification 
type descriptors. 



Claims 

1 . Apparatus for handling data transfers in a computer 
system that contains a processor subsystem, a 
memory subsystem, peripheral devices, device con- 
trol units controlling said peripheral devices in 
response to commands received from said proces- 
sor subsystem, and a channel linking said device 
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control units to said processor and memory subsys- 
tems, said channel having a peer communication 
feature enabling said control units to communicate 
directly with each other without intervention of said 
- processor subsystem and without intermediate s 
buffer storage in said memory subsystem of infor- 
mation being communicated between said control 
units, said apparatus being arranged to enable one 
of said control units to direct processing of a data 
stream of arbitrary length, by a device controlled by 10 
said one control unit, in cooperation with first and 
second other said control units respectively control- 
ling first and second other devices, said apparatus 
comprising: 

means in said one control unit for receiving is 
setup command information defining: (1) input and 2. 
output buffer storage spaces in said memory sub- 
system that are to be managed by said one control 
unit in cooperation respectively with said first and 
second other control units; (2) a notification protocol, 20 
defining signals to be directly transferred between 
said one control unit and said first and second other 
control units via said peer communication feature of 
said channel, said signals to be used by said control 3. 
units for managing use of said input and output 2S 
buffer storage spaces; and (3) a process to be con- 
ducted, on a said data stream of arbitrary length in 
said input buffer storage space, by said device con- 
trolled by said one control unit, said data to be written 4. 
to said input buffer storage space by said first other 30 
device, said process to produce result data to be 
written to said output buffer storage space for further 
handling by said second other device, and said proc- 
ess to be conducted to completion without interrup- 
tion of said processor subsystem; said input and out- 35 
put buffer storage spaces being characterized in that 
each has insufficient storage capacity to simultane- 
ously store all of the data potentially contained in 
said data stream; 

means in said one control unit responsive to 40 
said setup command information for preparing said 
one control unit and said device controlled by said 5. 
one control unit to: (1 ) perform said process defined 
by said command information on a said data stream 
to be conveyed through said input buffer storage *s 
space; (2) forward data resulting from performance 
of said process to said second other device via said 
output buffer storage space; and (3) manage usage 
of said input and output buffer storage space, in 
cooperation respectively with said first and second so 
other control units, via said notification protocol and 
said peer communication feature of said channel; 
and 

means in said one control unit, responsive to 
an initiating signal from said processor subsystem ss 
and to conditions established by said preparing 
means, for directing a streaming operation in which: 6. 
(1) said process is performed on data of said data 
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stream forwarded through said input buffer storage 
space; (2) data resulting from performance of said 
process is forwarded to said second other device via 
said output buffer storage space; (3) transport of 
said data stream through said input buffer storage 
space, and transport of said resulting data through 
said output buffer storage space, are jointly man- 
aged by said one control unit and said first and sec- 
ond other control units using said notification proto- 
col and said peer communication feature of said 
channel; and (4) all of the foregoing functions are 
carried out to completion, i.e., until all of the data in 
the data stream has been processed and forwarded, 
without interruption of said processor subsystem. 

The apparatus as claimed in claim 1 wherein said 
setup command information received by said one 
control unit is in the form of a plurality of variously 
sized requests, each request containing a parame- 
ters field including one or more descriptors, each 
descriptor defining a function essential to said 
streaming operation. 

The apparatus as claimed in claim 2 wherein said 
descriptors include information defining dimensions 
of said input and output buffer storage spaces in said 
memory subsystem. 

The apparatus as claimed in claim 3 wherein said 
descriptors include information defining an input 
buffer group constituting said input buffer storage 
space, said input buffer group containing at least two 
discretely separate variably sized storage sub- 
spaces, information defining dimensions of each of 
said subspaces, and information allowing for simul- 
taneous access to said subspaces of said input 
group to enable said first other device to be writing 
data to one of said subspaces while said device con- 
trolled by said one control unit is reading data from 
another one of said subspaces. 

The apparatus as claimed in claim 3 wherein said 
descriptors include information defining an output 
buffer group constituting said output buffer storage 
space, said output buffer group consisting of at least 
two discretely separate storage subspaces, infor- 
mation defining dimensions of individual storage 
subspaces in said output buffer group, and informa- 
tion configuring said one control unit to manage 
access to said output buffer group in coordination 
with said second other control unit so as to allow said 
second other device to read and process data occu- 
pying one of said subspaces while data produced by 
said device controlled by said one control unit is 
being written to another one of said subspaces. 

The apparatus as claimed in claim 4 wherein said 
descriptors include information defining a communi- 



15 



BNSDCCID: <EP 0694847 A2J_> 



29 



EP 0 694 847 A2 



30 



7. 



8. 



cation protocol between said one control unit and 
said first other control unit, to be conducted via said 
peer communication feature of said channel; said 
protocol enabling said one control unit and said first 
other control unit to control time interleaved access 
to said subspaces in said input buffer group, by said 
device controlled by said one and said first other 
device, in a manner ensuring that data in said data 
stream is moved efficiently through said input buffer 
group. 

The apparatus as claimed in claim 5 wherein said 
notification protocol is of a form enabling said one 
control unit and said second other control unit to 
jointly manage access to said subspaces in said out- 
put buffer group, by said device controlled by said 
one control unit and said device controlled by said 
second other control unit, in a manner ensuring that 
said result data is moved efficiently through said out- 
put buffer group. 

The apparatus as claimed in claim 1 including: 

means in said one control unit for providing a 
signal to said processor subsystem when said 
means for preparing said one control unit to conduct 
said streaming operation concludes its actions; said 
signal to said processor subsystem serving to indi- 
cate either that said one control unit is prepared for 
said streaming operation or that said one control unit 
can not be prepared for said streaming operation 
due to error; said signal to said processor subsystem 
preceding issuance of said initiating signal by said 
processor subsystem, and being used by said proc- 
essor subsystem as a condition precedent to issu- 
ance of said initiating signal. 
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The apparatus as claimed in claim 1 wherein: 

said setup command information includes syn- 
chronization information enabling said one control 
unit to synchronize said streaming operation to 
another streaming operation occurring external to 
said one control unit. 

The apparatus as claimed in claim 3 wherein: 

said input buffer storage space is configured 
for use as a FIFO (first in first out) buffer device, 
receiving blocks of data sequentially from said first 
other device and providing access to said blocks of 
data to said device controlled by said one control un it 
in the sequence in which the respective blocks were 
received. 

A device adapter for controlling a device performing 
operations requiring processing of arbitrarily long 
data streams in a computer system, said adapter 
comprising: 

means enabling said adapter to communicate 
directly with other device adapters through a chan- 
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nel of said computer system having a peer commu- 
nication feature permitting such direct communica- 
tion; 

means for receiving setup command informa- 
tion from said computer system 

defining: (1) an output buffer store having 
dimensions chosen by said computer system; (2) a 
source of data to be supplied sequentially to said 
device controlled by said adapter, said data consti- 
tuting a data stream of arbitrary length; (3) a process 
to be conducted by said device controlled by said 
adapter, on all of the data in said data stream, with 
data resulting from said process to be written into 
said output buffer for further process handling by 
another device controlled by another adapter; and 
(4) a protocol for communications to be conducted 
between said adapter and said another adapter, dur- 
ing the performance of said process on said data 
stream, to coordinate the use of said output buffer 
by said device and said another device; wherein the 
length of said data stream exceeds the capacity of 
said output buffer, requiring repeated use of said 
output buffer to convey portions of said resulting 
data to said another device through said output 
buffer, and wherein said protocol requires use of 
said direct communication feature of said channel to 
indicate when data in said output buffer is available 
for further process handling by said another device- 
and 

means responsive to an initiating signal issued 
by said computer system after said setup command 
information has been received by said receiving 
means, and to said setup command information, for 
directing said device controlled by said adapter to 
perform said process, and for using said protocol to 
notify said another adapter when data representing 
discrete portions of said data stream is available in 
said output buffer store; said last-mentioned means 
causing said process to be performed continuously 
until all of the data in said data stream has been 
processed, without intermediate interruption of or 
further instructions from said computer system. 

An adapter according to claim 1 1 contained in a unit 
that is separate from said computer system and 
peripherally attached to said computer system 
through said channel. 

An adapter according to claim 1 1 implemented in a 
surrogate unit contained in a program executed by 
said computer system. 

An adapter according to any of claims 11 to 13 
wherein said output buffer store contains at least two 
sections, each section capable of storing a data 
block of predetermined length, and said communi- 
cation protocol allows for said device controlled by 
said adapter and said another device to have con- 
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current access to different said sections; whereby 
said another device can be processing a block of 
said resulting data in one of said sections while 
another block of resulting data is being entered into 
- another one of said sections. 5 

15. An adapter according to any of claims 11 to 14 
wherein: 

said output buffer store is contained in a mem- 
ory subsystem of said computer system which is 10 
accessible to said device controlled by said adapter 
through said channel; 

said information in said setup commands 
includes information defining the number of said 
sections in said output buffer store and dimensions is 
of each section; and 

said setup command information defining said 
communications protocol includes information 
defining events occurring in said sections as condi- 
tions precedent to initiating communications from 20 
said adapter to said another adapter, and the form 
of signals to be contained in said communications. 

16. An adapter according to any of claims 11 to 15 
wherein said computer system is capable of initial- 2s 
ing concurrent processing of multiple different data 
streams, by devices controlled by said adapter and 
other adapters, and the setup command information 
furnished to said adapter includes information for 
synchronizing the processing of one data stream, in 30 
said device controlled by said adapter, with the 
processing of a different data stream in a different 
device. 

1 7. An adapter according to claim 16 wherein said syn- 3S 
chronizing information includes information defining 

the location of a timing function in the memory of said 
computer system which provides a time reference 
to the processing of said different data stream. 

40 

1 8. An adapter according to any of claims 1 1 to 1 7 which 
controls one or more devices capable of performing 
a plurality of different transformational processes on 
data, and said setup command information includes 
information defining a selected one of said plurality 45 
of transformational processes as said process to be 
performed on said data stream. 

19. A computer system comprising: 

a processor subsystem; so 
a memory subsystem; 
plural device adapters; 

plural devices controlled by said adapters; and 
an I/O channel linking said subsystems, said 
adapters, and said devices; wherein: ss 

said channel includes a peer communication 
feature enabling said adapters to directly exchange 
control information without involvement of any of 



said subsystems; 

said processor subsystem includes means for 
concurrently preparing at least two of said adapters, 
and respective devices controlled by said at least 
two adapters, to autonomously process data in a 
data stream of arbitrary length without interrupting 
said processor subsystem until all of the data has 
been processed; 

said preparing means includes: 

means for furnishing said at least two adapters 
with information defining: buffer storage spaces in 
said memory subsystem to be cooperatively man- 
aged by said adapters for forwarding the data in said 
data stream between devices controlled by said at 
least two adapters; a process to be conducted by 
devices controlled by said at least two adapters on 
the data in said data stream; and a communication 
protocol to be observed by said at least two adapt- 
ers, via said peer communication feature of said 
channel, for indicating when said buffer storage 
spaces contain data that is available to be read and 
processed by said devices controlled by said at least 
two adapters; said buffer storage spaces having 
insufficient storage capacity to simultaneously store 
all of the data in said data stream; 

means for receiving indications from said at 
least two adapters when said adapters are respec- 
tively prepared for controlling processing of data in 
said data stream; and 

means for signalling said at least two adapters 
to begin controlling processing of said data stream; 

and said at least two adapters include means 
responsive to said signal to begin to control respec- 
tive devices to process data in said data stream; said 
adapters cooperating via said communication pro- 
tocol to manage access to said buffer storage 
spaces and control processing of data in said data 
stream autonomously, without interrupting said 
processor subsystem, until all of the data in said data 
stream has been processed. 

20. A computer system containing processor and mem- 
ory subsystems, a channel linked to said subsys- 
tems, said channel having a peer communication 
feature, and plural device control units and data han- 
dling devices linked to said subsystems via said 
channel, said control units being able to intercom- 
municate directly with each other via said peer com- 
munication feature, wherein said system comprises: 

a source of data representing a data stream of 
arbitrary length to be processed sequentially by a 
plurality of said devices; 

means in said processor subsystem for pre- 
paring at least two of said control units to control 
processing of said data stream by devices respec- 
tively controlled by said at least two control units; 
said preparation including furnishing said control 
units with information defining variably sized and 
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variably located data buffers in said memory subsys- 
tem that are to be shared by pairs of devices con- 
trolled by said at least two control units, said buffers 
being filled with data by one device of each pair and 
emptied by the other device of the respective pair s 
said buffers shared by any said pair of devices hav- 
ing insufficient capacity to store the entire data 
stream at one time; said preparation further includ- 
ing indications by said at least two control units to 
said processor subsystem when respective control w 
units are prepared to control processing of said data 
stream by respective devices, and issuance of an 
initiating signal from said processor subsystem to at 
least one of said at least two control units when all 
of said at least two control units have indicated their is 
preparation; and 

means in said at least two control units, 
responsive to said initiating signal and information 
received during said preparation, for controlling 
respective devices to sequentially process all of the zo 
data in said data stream without interruption of said 
processor subsystem; said at least two control units 
cooperating in pairs to control forwarding of data 
between devices controlled by each pair of units; 
said responsive means in each said pair of control 2s 
units using said notification protocol to indicate when 
a buffer shared by a pair of devices controlled by the 
respective pair of units, contains data written by one 
device of the pair that is available for processing by 
the other device of the same pair. 30 

A data handling system comprising: 

processor and memory subsystems; 
at least two control units; 

at least two data handling devices respectively 35 
controlled by said at least two control units; and 

a channel linking said control units and 
devices to said processor and memory subsystems; 
said channel having a peer communication feature 
allowing for said at least two control units to inter- 40 
communicate directly with each other without 
involvement of said processor subsystem; and 
wherein: 

said processor subsystem includes means for 
setting up and initiating a data streaming operation, 4S 
to be autonomously controlled by said at least two 
control units, in which: a data stream of arbitrary 
length is to be handled in succession by said at least 
two devices, said data is to be passed to successive 
said devices through a shared memory buffer alio- so 
cated by said processor subsystem, and said 
devices are each to perform a data transformation 
function selectively specified by said processor sub- 
system; and 

each of said at least two control units includes ss 
means conditioned by said setting up and initiating 
means for directing the performance of said data 
streaming operation by a respective one of said at 



least two devices in an autonomous manner, requir- 
ing no interruption of said processor subsystem prior 
to completion of the operation, and in a manner 
which effectively isolates the respective device from 
conditions and events occurring external to that 
device; said directing means including means for 
managing repeated use of said shared memory buff- 
ers allocated by said processor subsystem to supply 
data in said data stream to the respective device and 
carry transformed data in said data stream away 
from the respective device; said repeated use being 
managed in coordination with other said at least two 
control units, via notification communications con- 
veyed between said control units through said chan- 
nel, and in a manner which isolates the respective 
device from buffer reuse events occurring as a result 
of said notification communications. 
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(54) Data streaming in a computer system 

(57) A data handling arrangement for a computer 
system, with particular application to multimedia sys- 
tems, allows device adapters (control units) attached to 
the system to. autonomously (without interrupting the 
system processor) control processing of a data stream 
of arbitrary length through memory buffers which are 
smaller than the stream. In this (stream processing) op- 
eration, data constituting the data stream flows through 
devices controlled by the adapter in succession, and is 
held in shared memory buffers as it passes between de- 
vices. The adapters are prepared for the stream 
processing operation by a system processor, indicate 
their preparation status to the processor, receive an in- 
itiating signal from the processor, and then proceed to 
direct the operation to completion without further assist- 
ance from the processor. In the operation, the adapters 
coordinate usage of the memory buffers by respective 
devices. Coordination is accomplished using a notifica- 
tion signalling protocol defined during preparation of the 
adapters. For notifying each other of buffer events (fill- 
ing, emptying, etc.), the adapters use a peer communi- 
cation feature of a system channel which connects the 
adapters and devices to the system processor and 
memory. This feature permits one adapter to directly 
communicate "notification" information to another con- 
trol unit without involving the system processor. Infor- 
mation furnished to the adapters during their prepara- 
tion includes descriptors defining the memory buffers 
and the notification protocol. It also may include descrip- 



tors enabling a control unit to synchronize the process- 
ing of data in a stream with events external to the 
stream; e.g. an external timer function or events asso- 
ciated with the processing of another data stream. Thus, 
for instance, video and audio components of a live mo- 
tion picture presentation could be synchronized. The 
controlling functions affecting stream processing are 
isolated from the controlled devices, and the processing 
functions performed by each device on data in a stream 
are performed independent of the functions performed 
by any other device relative to the same stream; thereby 
simplifying development of new devices and new 
processing functions. 
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